Skip to content

Pin Agentic Triage to a supported Copilot model - #11826

Merged
Timothee Guerin (timotheeguerin) merged 5 commits into
mainfrom
copilot/fix-agentic-triage-failure
Sep 3, 2026
Merged

Pin Agentic Triage to a supported Copilot model#11826
Timothee Guerin (timotheeguerin) merged 5 commits into
mainfrom
copilot/fix-agentic-triage-failure

Conversation

Copilot AI commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Agentic Triage failed when repository or organization defaults selected a model unavailable to the agentic-workflows integration.

  • Workflow configuration

    • Pin the Copilot engine to claude-sonnet-5.
    • Prevent external model defaults from overriding the workflow.
  • Generated workflow

    • Regenerate issue-triage.lock.yml with the pinned model.

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
1 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI linked an issue Sep 2, 2026 that may be closed by this pull request
Co-authored-by: timotheeguerin <1031227+timotheeguerin@users.noreply.github.com>
Comment thread .github/workflows/issue-triage.md
Copilot AI changed the title [WIP] Fix Agentic Triage workflow configuration issue Pin Agentic Triage to a supported Copilot model Sep 2, 2026
Co-authored-by: timotheeguerin <1031227+timotheeguerin@users.noreply.github.com>
Comment thread .github/workflows/bump-tcgc-csharp.md
Co-authored-by: timotheeguerin <1031227+timotheeguerin@users.noreply.github.com>

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The workflow is pinned to gpt-5, which appears not to be available for the agentic-workflows integrator per the linked failure output, so the triage run may continue failing and the lock file should be regenerated after correcting the pinned model.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Pull request overview

This PR updates the Agentic Triage workflow configuration to pin the Copilot engine/model so repository/org defaults can’t select an unsupported model, and regenerates the compiled lock workflow accordingly.

Changes:

  • Switch .github/workflows/issue-triage.md from engine: copilot to an explicit engine.id + engine.model configuration.
  • Regenerate .github/workflows/issue-triage.lock.yml to hard-code the selected model in the compiled workflow (replacing prior ${{ vars... }} fallback logic).
File summaries
File Description
.github/workflows/issue-triage.md Pins the Agentic Triage workflow’s engine/model in frontmatter.
.github/workflows/issue-triage.lock.yml Regenerated compiled workflow reflecting the pinned model (and removing variable-based overrides).
Review details

Suppressed comments (4)

.github/workflows/issue-triage.lock.yml:127

  • This is pinned to gpt-5, but the failure issue’s error output lists models available to the agentic-workflows integrator and it does not include gpt-5 (it does include claude-sonnet-5). After changing the source workflow to a supported model, regenerate the lock file so all model fields match.
          GH_AW_INFO_ENGINE_ID: "copilot"
          GH_AW_INFO_ENGINE_NAME: "GitHub Copilot CLI"
          GH_AW_INFO_MODEL: "gpt-5"
          GH_AW_INFO_VERSION: "1.0.63"

.github/workflows/issue-triage.lock.yml:847

  • COPILOT_MODEL is pinned to gpt-5, but the failure issue’s error output indicates gpt-5 is not available for the agentic-workflows integrator. This should be updated to a supported model (e.g. claude-sonnet-5) by regenerating the lock file from the source workflow.
          COPILOT_AGENT_RUNNER_TYPE: STANDALONE
          COPILOT_DUMMY_BYOK: dummy-byok-key-for-offline-mode
          COPILOT_GITHUB_TOKEN: ${{ github.token }}
          COPILOT_MODEL: gpt-5
          GH_AW_MAX_AI_CREDITS: ${{ vars.GH_AW_DEFAULT_MAX_AI_CREDITS || '1000' }}

.github/workflows/issue-triage.lock.yml:1543

  • GH_AW_ENGINE_MODEL is hard-coded to gpt-5, but the failure issue’s error output suggests gpt-5 is not available for the agentic-workflows integrator (while claude-sonnet-5 is). Regenerate the lock file after updating the pinned model so the exported summary matches the actual supported model.
      GH_AW_EFFECTIVE_TOKENS: ${{ needs.agent.outputs.effective_tokens }}
      GH_AW_ENGINE_ID: "copilot"
      GH_AW_ENGINE_MODEL: "gpt-5"
      GH_AW_ENGINE_VERSION: "1.0.63"

.github/workflows/issue-triage.lock.yml:1447

  • The detection phase also pins COPILOT_MODEL to gpt-5, which (per the failure issue’s model availability list) is not available for the agentic-workflows integrator. Regenerate the lock file after switching to a supported model to avoid detection failures.
          COPILOT_AGENT_RUNNER_TYPE: STANDALONE
          COPILOT_DUMMY_BYOK: dummy-byok-key-for-offline-mode
          COPILOT_GITHUB_TOKEN: ${{ github.token }}
          COPILOT_MODEL: gpt-5
          GH_AW_MAX_AI_CREDITS: ${{ vars.GH_AW_DEFAULT_DETECTION_MAX_AI_CREDITS || '400' }}
  • Files reviewed: 2/2 changed files
  • Comments generated: 2
  • Review effort level: Lite

💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread .github/workflows/issue-triage.lock.yml Outdated
Comment thread .github/workflows/issue-triage.md Outdated
@azure-sdk-automation

Copy link
Copy Markdown

You can try these changes here

🛝 Playground 🌐 Website 🛝 VSCode Extension

@timotheeguerin

Copy link
Copy Markdown
Member

Copilot address review comments

Co-authored-by: timotheeguerin <1031227+timotheeguerin@users.noreply.github.com>
Copilot AI review requested due to automatic review settings September 2, 2026 19:49

Copilot AI commented Sep 2, 2026

Copy link
Copy Markdown
Contributor Author

Copilot address review comments

Addressed in 2555add: Agentic Triage now pins claude-sonnet-5, and its lock file was regenerated with gh-aw v0.80.9.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The workflow now deterministically uses a supported Copilot model and the regenerated lock file consistently reflects that pinning without remaining override paths.

Review details
  • Files reviewed: 2/2 changed files
  • Comments generated: 0 new
  • Review effort level: Lite

@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Sep 3, 2026
Merged via the queue into main with commit 417986c Sep 3, 2026
29 checks passed
@timotheeguerin
Timothee Guerin (timotheeguerin) deleted the copilot/fix-agentic-triage-failure branch September 3, 2026 15:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[aw] Agentic Triage failed

4 participants